Recent Results on No-Free-Lunch Theorems for Optimization
نویسندگان
چکیده
The sharpened No-Free-Lunch-theorem (NFL-theorem) states that the performance of all optimization algorithms averaged over any finite set F of functions is equal if and only if F is closed under permutation (c.u.p.) and each target function in F is equally likely. In this paper, we first summarize some consequences of this theorem, which have been proven recently: The average number of evaluations needed to find a desirable (e.g., optimal) solution can be calculated; the number of subsets c.u.p. can be neglected compared to the overall number of possible subsets; and problem classes relevant in practice are not likely to be c.u.p. Second, as the main result, the NFL-theorem is extended. Necessary and sufficient conditions for NFL-results to hold are given for arbitrary, non-uniform distributions of target functions. This yields the most general NFL-theorem for optimization presented so far.
منابع مشابه
Remarks on a recent paper on the "no free lunch" theorems
This letter discusses the recent paper Some technical remarks on the proof of the No Free Lunch the orem In that paper some technical issues related to the formal proof of the No Free Lunch NFL theorem for search were given As a result of a discussion among the authors this letter explores the issues raised in that paper more thoroughly This includes the presentation of a simpler version of the...
متن کاملThe Supervised Learning No-Free-Lunch Theorems
This paper reviews the supervised learning versions of the no-free-lunch theorems in a simpli ed form. It also discusses the signi cance of those theorems, and their relation to other aspects of supervised learning.
متن کاملArbitrary function optimisation with metaheuristics - No free lunch and real-world problems
No free lunch theorems for optimisation suggest that empirical studies on benchmarking problems are pointless, or even cast negative doubts, when algorithms are being applied to other problems not clearly related to the previous ones. Roughly speaking, reported empirical results are not just the result of algorithms’ performances, but the benchmark used therein as well; and consequently, recomm...
متن کاملNo Free Lunch Theorems: Limitations and Perspectives of Metaheuristics
The No Free Lunch (NFL) theorems for search and optimization are reviewed and their implications for the design of metaheuristics are discussed. The theorems state that any two search or optimization algorithms are equivalent when their performance is averaged across all possible problems and even over subsets of problems fulfilling certain constraints. The NFL results show that if there is no ...
متن کاملNew directions in genetic algorithm theory
Recently several classical Genetic Algorithm principles have been challenged-including the Fundamental Theorem of Genetic Algorithms and the Principle of Minimal Alphabets. In addition, the recent No Free Lunch theorems raise further concerns. In this paper we review these issues and offer some new directions for GA researchers.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره cs.NE/0303032 شماره
صفحات -
تاریخ انتشار 2003